next-generation language model
Proceedings of the First International Workshop on Next-Generation Language Models for Knowledge Representation and Reasoning (NeLaMKRR 2024)
Satoh, Ken, Nguyen, Ha-Thanh, Toni, Francesca, Goebel, Randy, Stathis, Kostas
Reasoning is an essential component of human intelligence as it plays a fundamental role in our ability to think critically, support responsible decisions, and solve challenging problems. Traditionally, AI has addressed reasoning in the context of logic-based representations of knowledge. However, the recent leap forward in natural language processing, with the emergence of language models based on transformers, is hinting at the possibility that these models exhibit reasoning abilities, particularly as they grow in size and are trained on more data. Despite ongoing discussions about what reasoning is in language models, it is still not easy to pin down to what extent these models are actually capable of reasoning. The goal of this workshop is to create a platform for researchers from different disciplines and/or AI perspectives, to explore approaches and techniques with the aim to reconcile reasoning between language models using transformers and using logic-based representations. The specific objectives include analyzing the reasoning abilities of language models measured alongside KR methods, injecting KR-style reasoning abilities into language models (including by neuro-symbolic means), and formalizing the kind of reasoning language models carry out. This exploration aims to uncover how language models can effectively integrate and leverage knowledge and reasoning with it, thus improving their application and utility in areas where precision and reliability are a key requirement.
- Research Report (0.66)
- Instructional Material > Course Syllabus & Notes (0.53)
Beyond the Buzzwords: How ChatGPT Stands Out as a Next-Generation Language Model - Datafloq
Since the release of ChatGPT, we've seen a lot of disturbance in almost every field of our life and business. We've heard that ChatGPT can be a junior specialist killer (it passed the interview for Google's L3 entry-level software engineering position) and that it can replace the search engines we are used to (actually, the author personally sometimes suggests asking ChatGPT instead of googling). Tech enthusiasts across the globe are looking forward to putting their hands on the new Bing based on Prometheus AI (an improved version of ChatGPT). We even have heard fears about such models becoming sentient and causing certain trouble. Is at least something from the abstract above actual and possible?